Digital camera recording a composite image

ABSTRACT

A digital camera capable of recording a subject image so that the subject image can be drawn as it is combined with a selected default image and so that the subject image can be drawn separately from the selected default image. The digital camera includes an image processor which creates subject image data based on output of an image sensor and a default image setting unit which stores subject image data in a removable memory together with information for associating background data with the subject image data, whereby the subject image data, rather than the data provided by combining the subject image data and the background data, is stored in the removable memory and the subject image data and the background data are associated with each other.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a Divisional of application Ser. No. 12/137,759 filed Jun. 12,2008, which is a Continuation of application Ser. No. 11/003,761 filedDec. 6, 2004 (issued as U.S. Pat. No. 7,466,350), which is Continuationof Application No. PCT/JP03/07138 filed Jun. 5, 2003, which claimspriority from Japanese Patent Application No. 2002-164044 filed Jun. 5,2002 and Japanese Patent Application No. 2003-005485 filed Jan. 14,2003. The disclosures of the aforementioned prior applications arehereby incorporated by reference.

TECHNICAL FIELD

This invention relates to a digital camera.

BACKGROUND ART

A digital camera has a use of recording a subject as material of acomposite image, for example. The composite image is widely used toprint a greeting card with a photo, a framed photo seal, etc.

Hitherto, a digital camera for recording a composite image provided bycombining a digital image representing a border and a background(default image) and a digital image representing a subject (subjectimage) in external memory has been known (for example, refer to patentdocument 1).

-   Patent document 1: JP-A-2001-45352

However, according to the digital camera disclosed in patent document 1,the default image and the subject image are combined before they arerecorded in the external memory, and thus the subject image before beingcombined is not recorded in the external memory. Thus, the subject imagecan be used only for the purpose of being combined with the defaultimage selected before photographing.

Considering such a problem, it is therefore an object of the inventionto provide a digital camera capable of recording a subject image so thatthe subject image can be drawn as it is combined with a selected defaultimage and that the subject image can be drawn separately from a selecteddefault image.

DISCLOSURE OF THE INVENTION

To accomplish the above-described object, a digital camera according tothe invention is characterized by image processing means for creatingsubject image data representing a subject image based on output of animage sensor; and subject image output means for storing subject imagedata and associating data for associating default image datarepresenting a default image combined with a subject image representedby the subject image data with the subject image data in nonvolatilememory. The subject image data representing the subject image ratherthan the image provided by combining the subject image and the defaultimage is stored in the nonvolatile memory, whereby the subject image canbe recorded so that the subject image can be drawn as it is combinedwith the selected default image and that the subject image can be drawnseparately from the selected default image.

Further, the digital camera according to the invention is characterizedin that the subject image output means stores associating data forassociating a plurality of pieces of default image data with one pieceof subject image data in the nonvolatile memory. One subject image andmultiple background images are associated with each other, whereby aplurality of composite images can be created from one subject image.

Further, the digital camera according to the invention is characterizedin that the subject image output means has first subject image outputmeans for setting a first default image before a shutter command isentered and storing first associating data for associating default imagedata representing the first default image with subject image data in thenonvolatile memory; and second subject image output means for setting asecond default image after a shutter command is entered and storingsecond associating data for associating default image data representingthe second default image with the subject image data associated with thefirst default image in the nonvolatile memory, and that the firstdefault image and the second associating data are distinguished fromeach other with respect to the setting time of the default image. If aplurality of combinations of default images and subject images are set,it becomes hard to determine which of the combinations is thecombination for bringing the subject image and the default image intoharmony with each other, intended by the operator in entering theshutter command. Since the combination of the default image and thesubject image set before the shutter command is entered is distinguishedfrom the combination set after the shutter command is entered, thecombination for bringing the subject image and the default image intoharmony with each other, intended by the operator in entering theshutter command can be determined easily.

Further, the digital camera according to the invention is characterizedin that the subject image output means uses a table to associate thedefault image data with the subject image data. Accordingly, it becomeseasy to edit and use the information for associating the default imagewith the subject image.

Further, the digital camera according to the invention is characterizedin that the associating data associates layout definition data fordefining playback layout of the subject image and the default image withthe subject image data. The subject image data is stored in memory inassociation with the layout definition data, whereby it is made possibleto control the layout of the subject image and the default image for thecomposite image with the digital camera.

Further, the digital camera according to the invention is characterizedin that the digital camera further includes default image selectionmeans for selecting the default image data to be associated with thesubject image data before and after a shutter command is entered, andthat the associating data associates the default image data selectedthrough the default image selection means with the subject image datathrough the layout definition data so that whether the default imagedata associated with the subject image data by the associating data isselected before or after the shutter command is entered can bedetermined. Whether the default image data representing the defaultimage combined with the subject image is selected before or after theshutter command is entered can be determined by the associating data, sothat whether or not the combination of the subject image and the defaultimage determined by the associating data is the combination intended bythe operator in entering the shutter command can be determined after thefact just before print, etc.

Further, the digital camera according to the invention is characterizedin that the layout definition data contains a plurality of layoutdefinition files each for defining playback layout of the subject imageand the default image for each playback medium size and an index filecontaining paths of the plurality of layout definition files, and thatthe associating data is stored in a file having a file name at least apart of which matches the file name of the file storing the subjectimage data and contains the path of the index file. Subject image isstored in the memory in association with a plurality of layoutdefinition files each for defining playback layout of the subject imageand the default image for each playback medium size through the an indexfile, whereby it is made possible to control the layout of the subjectimage and the default image for the composite image played back onplayback media of different sizes for each playback medium size with thedigital camera.

Further, the digital camera according to the invention is characterizedin that the nonvolatile memory is removable memory. Subject image datais stored in the removable memory, whereby it is made possible totransmit the subject image data through the removable memory to adifferent image processing apparatus from the digital camera recordingthe subject image.

Further, the digital camera according to the invention is characterizedin that the digital camera further includes playback layout output meansfor storing the default image data representing a default image andlayout definition data for defining playback layout of subject image andthe default image in the removable memory. Default image and layoutdefinition data are stored in the removable memory together with subjectimage data, whereby it is made possible to play back the composite imageof the subject image and the default image according to the playbacklayout defined in the layout definition data in a different imageprocessing apparatus from the digital camera recording the subjectimage. That is, it is made possible to control the layout of the subjectimage and the default image for the composite image played back in adifferent image processing apparatus with the digital camera.

Further, the digital camera according to the invention is characterizedin that the layout definition data contains a plurality of layoutdefinition files each for defining playback layout of the subject imageand the default image for each playback medium size and an index filecontaining paths of the plurality of layout definition files, and thatthe associating data is stored in a file having a file name at least apart of which matches the file name of the file storing the subjectimage data and contains the path of the index file. Subject image isstored in the removable memory in association with a plurality of layoutdefinition files each for defining playback layout of the subject imageand the default image for each playback medium size through the an indexfile, whereby it is made possible to control the layout of the subjectimage and the default image for the composite image played back onplayback media of different sizes for each playback medium size with thedigital camera.

Further, the digital camera according to the invention is characterizedin that the digital camera further includes display means for displayinga composite image provided by combining the subject image represented bysubject image data and the default image represented by the defaultimage data associated with the subject image data. The composite imageprovided by combining the subject image and the default image isdisplayed, whereby it is made possible to check the composite image withthe digital camera.

Further, the digital camera according to the invention is characterizedin that the digital camera further includes print control means forcausing a printer to print a composite image provided by combining thesubject image represented by subject image data and the default imagerepresented by the default image data associated with the subject imagedata. The digital camera causes a printer to print the composite image,whereby it is made possible to easily print the composite image of thesubject image recorded in the digital camera without using a personalcomputer, etc.

Further, the digital camera according to the invention is characterizedin that the print control means creates print data of a composite imageprovided by combining the subject image represented by subject imagedata and the default image represented by the default image dataassociated with the subject image data and causes the printer to printthe composite image based on the print data. The print data is createdin the digital camera, whereby it is made possible to easily print thecomposite image of the subject image recorded in the digital camera evenwith a printer that cannot create the print data based on the subjectimage data and the default image data.

The functions of the plurality of means included in the invention areprovided by hardware resources whose functions are determined by theconfiguration and hardware resources whose functions are determined byprograms, or by combining them. The functions of the plurality of meansare not limited to those provided by hardware resources physicallyindependent of each other. The invention can be determined not only asthe invention of an apparatus, but also as the invention of a program,the invention of a record medium recording the program, and theinvention of a method.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic drawing according to a first embodiment of theinvention.

FIG. 2 is a block diagram according to the first embodiment of theinvention.

FIG. 3A is a rear view according to the first embodiment of theinvention and FIG. 3B is a front view according to the embodiment of theinvention.

FIG. 4 is a schematic drawing according to the first embodiment of theinvention.

FIG. 5 is a flowchart according to the first embodiment of theinvention.

FIG. 6 is a flowchart according to the first embodiment of theinvention.

FIG. 7 is a schematic drawing according to the first embodiment of theinvention.

FIG. 8 is a schematic drawing according to a second embodiment of theinvention.

FIG. 9 is a schematic drawing according to the second embodiment of theinvention.

FIG. 10 is a schematic drawing according to the second embodiment of theinvention.

FIG. 11 is a schematic drawing according to the second embodiment of theinvention.

FIG. 12 is a screen transition drawing according to the secondembodiment of the invention.

FIG. 13 is a flowchart according to the second embodiment of theinvention.

FIG. 14 is a schematic drawing according to the second embodiment of theinvention.

BEST MODE FOR CARRYING OUT THE INVENTION

Embodiments of the invention will be discussed below based onembodiments.

First Embodiment

FIG. 2 is a block diagram to show the configuration of a digital cameralaccording to a first embodiment of the invention. FIGS. 3A and 3B are afront view and a rear view to show the appearance of the digital camera1.

A lens drive section 72 drives a zoom lens 40 so as to form a subjectimage on the light reception section of an image sensor 44 at thescaling factor responsive to a signal input from a CPU 68. An aperturedrive section 74 drives an optical aperture 42 so that the incidentlight amount on the image sensor 44 becomes the incident light amountresponsive to a signal input from the CPU 68.

The image sensor 44 is an area image sensor formed with an on-chip colorfilter array made up of four complementary color filters of C (Cyan), M(Magenta), Y (Yellow), and G (Green) for storing the charges provided byexecuting photoelectric conversion of received light for a given timeand outputting an electric signal responsive to the light receptionamount for each photoelectric conversion element. The color filter arraymay be made up of three complementary color filters of C, M, and Y ormay be made up of primary color filters of R (Red), G (green), and B(Blue).

A CDS circuit 46 performs reduction processing of noise contained in theanalog electric signal. An AGC circuit 48 performs gain control, therebyadjusting the level of the analog electric signal. An A/D converter 50quantizes the analog electric signal subjected to the processingdescribed above into a digital signal of a determined gradation. A scancontrol section 76 outputs a shift pulse, a vertical transfer pulse, ahorizontal transfer pulse, etc., to the image sensor 44 and outputs adrive pulse to the CDS circuit 46, the AGC circuit 48, and the A/Dconverter 50 to operate these components in synchronization with theimage sensor 44.

A digital image processing section 52, which is implemented, forexample, as a DSP (Digital Signal Processor), performs image generationprocessing, white balance correction, γ correction, color spaceconversion, etc., based on the image signal output from the A/Dconverter 50, creates subject image data representing R, G, and Bgradation values, Y, Cb, and Cr gradation values, etc., for example, foreach pixel, and stores the subject image data in RAM 66. The imagegeneration processing mentioned here is processing of mainly generatingimage data having three gradation values for each pixel by interpolationprocessing using digital data representing the gradation value of any ofCMYG corresponding to output of each photoelectric conversion element.

A compression-decompression processing section 54 compresses the subjectimage data output from the digital image processing section 52 to createcompressed image data in conformity with a JPEG format, for example, ina photographing mode and decompresses the compressed image data readfrom removable memory 57 using a reader/writer 56 and stores thedecompressed image data in the RAM 66 in a playback mode. The removablememory 57 implemented as nonvolatile memory such as flash memory can beattached to and detached from the reader/writer 56, and thereader/writer 56 writes data into the removable memory 57 and reads datastored in the removable memory 57.

An operation section 64 includes various buttons such as a power button14 for turning on/off power, a dial switch 16 for setting a mode such asthe photographing mode, the playback mode, or a direct print mode, ashutter button 28 for entering a shutter command, a background settingbutton 18 for setting a background in the photographing mode, zoombuttons 10 and 12 for setting the magnification or scaling factor of azoom lens, a next selection key 20, a preceding selection key 22, and adetermination key 24, and a circuit for detecting the user pressing anybutton and the rotation angle of the dial switch 16.

A display control section 58 performs processing of thinning out theimage data stored in the RAM 66 at a fixed scaling factor in response tothe display area of the display, color space conversion processing,combining processing, etc., and drives an LCD (Liquid Crystal Display)26 as the display based on the display data created by performing theprocessing. A frame buffer 62 contains a background area and aforeground area for separately storing the image data to be combined.The display control section includes a combining processing circuit fordisplaying a composite image on the LCD 26 by displaying the pixels ofthe image data stored in the background area taking precedence over thetransparent pixels of the image data stored in the foreground area anddisplaying the opaque pixels of the image data stored in the foregroundarea taking precedence over the pixels of the image data stored in thebackground area.

The CPU 68 controls the whole digital camera 1 by executing a computerprogram stored in ROM 70. The ROM 70 is memory for storing the computerprogram, etc., for the CPU 68 to execute various types of control. TheRAM 66 is memory for temporarily storing various programs and variouspieces of data.

The configuration of the digital camera 1 has been described. Next,background data as a default image will be discussed.

FIG. 4 is a schematic drawing to show background files recorded in theremovable memory 57.

The background file, which is provided for creating printed matter of agreeting card with a photo, a photo seal, etc., is transferred from apersonal computer, etc., and is previously stored in the ROM 70 or theremovable memory 57. In the description that follows, it is assumed thatthe background files are stored in a background folder of the removablememory 57 as shown in FIG. 1. The background data stored in thebackground file represents an image 80, 82 made up of a line drawing,fills, text, etc. The hatched area is an area into which the subjectimage represented by subject image data is fitted (transparent area). Asthe gradation value of each pixel in the transparent area, apredetermined value representing transparency, such as R=00H, G=00H,B=00H, for example, is set.

The background file is made up of data indicating the number of pixelsof the background data, the coordinates with which the origincoordinates of the subject image data are matched (coordinates ofcomposite origin), the number of reference pixels of layout data, theprint size, the print orientation of the background data (portrait,landscape), etc., in addition to the background data. At the combiningprocessing time before print, a comparison is made between the number ofreference pixels of layout data and the number of pixels of the subjectimage data to be laid out, the background data is thinned out orinterpolated to the size responsive to the number of pixels of thesubject image data to be laid out, and the coordinates of the compositeorigin are converted accordingly.

For example, if the number of pixels of the background data is(1280×640), the coordinates of the composite origin are (20, 20), thenumber of reference pixels of layout data is (640×480), and the numberof pixels of the subject image data is (1280×960), the number of pixelsof the subject image data is twice the number of reference pixels inboth horizontal and vertical directions and thus the combiningprocessing before print is performed as follows: The background data isinterpolated to set the number of pixels of the background data to(2560×1280), the coordinates of the composite origin are converted into(40, 40), and the image represented by the background data and the imagerepresented by the subject image data are combined so that the imagerepresented by the subject image data overlaps in the range of (40, 40)to (1320, 1000) of the image represented by the background data afterconversion. At the print time, further interpolation processing,thinning-out processing, or rotation processing is performed based onthe print size, the print orientation of the background data, etc.,previously stored in the background file, and a composite image of thesetup print size and in the setup print orientation is printed on aprinter.

If the image represented by the subject image data and the imagerepresented by the background data are combined into a composite imagein a personal computer or a standalone printer and then the compositeimage is printed and it is not assumed that the digital camera 1 and aprinter are directly connected for printing, the true background dataused to create composite image data for print may be previously storedin the personal computer or the standalone printer and displayprocessing in the digital camera 1 may be executed using data with acoarse gradation at a lower resolution than that of the true backgrounddata. In doing so, the background data does not put pressure on thememory space of the digital camera 1 and the background data can beprocessed at high speed.

The background data has been described. Next, the operation of thedigital camera 1 will be discussed.

FIG. 5 is a flowchart to show a processing flow for storing subjectimage data in the removable memory 57 in association with backgrounddata before photographing. The sequence shown in FIG. 5 is started as anoperator presses the background setting button 18 in the photographingmode determined by the rotation angle of the dial switch 16.

At step S100, any one of the background files stored in the removablememory 57 is selected. At step S105, the background image represented bythe background data stored in the selected background file is displayedon the LCD 26. At step S110, when the next selection key 20 is pressed,the process returns to step S100 and another background file is selectedand the above-described processing is repeated.

When the determination key 24 is pressed at step S120, at step S130, thesubject image is displayed as a moving image in the transparent area ofthe image represented by the background data. Accordingly, it is madepossible to create the subject image data representing an image inharmony with the image represented by the background data selected asthe determination key 24 is pressed at step S120. Specifically, thebackground data selected at steps S100 to A120 and the subject imagedata created by the digital image processing section 52 are stored inthe frame buffer 62 and the display control section 58 combines thesubject image data and the background data stored in the frame buffer 62and outputs a drive signal to the LCD 26, whereby composite image data83 is displayed as shown in FIG. 3 (A). The subject image data isupdated every predetermined time.

At step S140, whether or not a shutter command is entered, namely,whether or not the shutter button 28 is pressed is detected. If theshutter button 28 being pressed is not detected, the process returns tostep S130 and the above-described processing is repeated. If the shutterbutton 28 being pressed is detected at step S140, the process goes tostep S150.

At step S150, a predetermined control signal is input to the scancontrol section 76, the charges accumulated in the image sensor 44 for apredetermined time are scanned, subject image data is created in thedigital image processing section 52, and the subject image data iscompressed by the compression-decompression processing section 54 tocreate compressed image data, which is then stored in a subject folderof the removable memory 57 by the reader/writer 56 in a predeterminedfile format such as JPEG.

At step S160, information to associate the subject image data recordedat step S150 and the background file selected as the determination key24 is pressed at step S110 with each other is stored in the removablememory 57. Specifically, an associating record is created with the filename of the subject image data recorded at step S150 as “subject filename,” the file name of the background file selected as thedetermination key 24 is pressed at step S110 as “background file name,”and before photographing as “setting time,” and is added to a settingtable T shown in FIG. 1. The associating record added at this timecorresponds to first associating data as claimed in claims.

Here, the setting table T for managing the information to associate thesubject image data and the background file with each other will bediscussed. The setting table T is recorded in a setting folder of theremovable memory 57. The setting table T is made up of associatingrecords for associating the subject files and the background files witheach other in a one-to-one correspondence. Each associating record ismade up of ID, subject file name, background file name, and settingtime. The “subject file name” is data for uniquely identifying thesubject file storing subject image data in a file system of the digitalcamera 1, personal computer, etc. The “background file name” is data foruniquely identifying the background file in the file system of thedigital camera 1, personal computer, etc. The “setting time” is dataindicating whether the associating record is created beforephotographing or is created or edited after photographing. That is, theassociating record with before photographing as the “setting time” is anassociating record created at step S160 and an associating record notedited later. The associating record with after photographing as the“setting time” is an associating record added or overwritten in abackground setting mode described later. Whether or not the “settingtime” is before photographing is determined, whereby it is made possibleto determine whether or not the combination of the background file andthe subject file associated with each other according to the associatingrecord is a combination for bringing the subject and the background intoharmony with each other, intended by the operator in entering theshutter command. When the shutter command is entered in a state in whichno background data is set, an associating record with “no background”set in the “background file name” may be created and be added to thesetting table each time for each shutter command.

An unlimited number of associating records each for associating asubject file and a background file with each other in any combinationcan be added to the setting table T within the upper limit of the memorycapacity. Associating records for associating different background fileswith one subject file (in the example in FIG. 1, associating recordswith ID 3 and ID 4) can be created. Therefore, using the setting tableT, information for associating two or more background files with onesubject file can be stored in the removable memory 57.

The subject image data and the background data may be associated witheach other not only according to a table, but also according to adirectory or may be associated with each other by storing the file nameof the associated file in the subject file or the background file.

The processing flow of storing the information to associate the subjectimage data with the background data in the removable memory 57 has beendescribed. Next, processing of setting associating of subject image dataand background data with each other after photographing will bediscussed.

FIG. 6 is a flowchart to show the processing. The sequence shown in FIG.6 is started as the rotation angle of the dial switch 16 correspondingto the playback mode is detected in the operation section 64.

At step S200, any one of the associating records stored in the settingtable T is selected. At step S210, the subject image data with thesubject file name stored in the selected associating record is displayedon the LCD 26. At this time, if a background file is associated with thesubject file in the selected associating record, text or an iconindicating the fact is combined with the subject for display as shown inFIG. 7 (A).

At step S220, whether or not the next selection key 20 is pressed isdetected. If the next selection key 20 is pressed, the process returnsto step S200 and another associating record is selected and theabove-described processing is repeated. If the next selection key 20 isnot pressed at step S220, the process goes to step S230 and whether ornot a mode switch command is entered, namely, whether or not therotation angle of the dial switch 16 is changed is detected. If a modeswitch command is entered, the playback mode is terminated and isswitched into another mode. If a mode switch command is not entered atstep S230, the process goes to step S240 and whether or not thebackground setting key 18 is pressed is detected. If the backgroundsetting key 18 is pressed, the process goes to step S250 and atransition is made to the background setting mode. The mode forexecuting the processing sequence of steps S250 to S310 is called thebackground setting mode. If the background setting key 18 is not pressedat step S240, the process returns to step S220 and the above-describedprocessing is repeated.

At step S250, any one of the background files stored in the removablememory is selected. In the first processing executed just after stepS240, the background file associated according to the associating recordselected at step S200 is selected. At step S260, the image representedby the subject image data associated according to the currently selectedassociating record and the image represented by the background dataselected at step S250 are combined and the composite image is displayedon the LCD 26. Specifically, the background data and the subject imagedata are stored in the frame buffer 62 and the display control section58 combines the subject image data and the background data stored in theframe buffer 62 and outputs a drive signal to the LCD 26, wherebycomposite image data 84 shown in FIG. 7 (B) is displayed.

At step S270, whether or not the next selection key 20 is pressed isdetected. If the next selection key 20 is pressed, the process returnsto step S250, another piece of background data is selected, theabove-described processing is repeated, and composite image data 85, forexample, shown in FIG. 7 (C) is displayed. If the next selection key 20is not pressed, the process goes to step S280 and whether or not thedetermination key 24 is pressed is detected. Steps S270 and S280 arerepeated until the next selection key 20 or the determination key 24 ispressed. If the determination key 24 is pressed, the process goes tostep S290.

At step S290, to record information for associating the subject imagedata associated according to the currently selected associating recordand the background file selected at step S250 with each other in thesetting table T, the operator is requested to select overwriting thecurrently selected associating record or adding a new associatingrecord. Specifically, for example, buttons of “yes” and “no” aredisplayed on the LCD 26 together with a character string of “do youoverwrite?” and the operator is requested to select either of thebuttons of “yes” and “no” by pressing the next selection key 20, thepreceding selection key 22, and the determination key 24.

If the operator selects overwriting at step S290, the process goes tostep S300 and the background file name in the currently selectedassociating record is changed to the file name of the background dataselected at step S250 and “setting time” in the associating record ischanged to “after photographing.”

If the operator does not select overwriting at step S290, the processgoes to step S310 and a new associating record is created with thesubject file name in the currently selected associating record as“subject file name,” the file name of the background data selected atstep S250 as “background file name,” and “setting time” as “afterphotographing” and is added to the setting table T. The associatingrecord added at this time corresponds to second associating data asclaimed in claims. Upon completion of the processing at step S300 orS310, the process returns to step S240 and the above-describedprocessing is repeated.

The processing of setting associating of the subject image data and thebackground data with each other after photographing has been described.In the first embodiment of the invention, image processing means asclaimed in Claims is made up of the CDS circuit 46, the AGC circuit 48,the A/D converter 50, the digital image processing section 52, etc., andthe function is realized as the processing at steps S130 and S150 isperformed. The functions of subject image output means, first subjectimage output means, and second subject image output means as claimed inClaims are realized as the processing at steps S100, S105, S110, S120,and S160 is performed in the photographing mode and are realized as theprocessing at steps S250 to S310 is performed in the background settingmode. Particularly, the function of the first subject image output meansas claimed in claims corresponds to the processing at steps S100, S105,S110, and S120 in the photographing mode, and the function of the secondsubject image output means as claimed in claims corresponds to theprocessing at steps S250 to S310 in the background setting mode.

In the first embodiment of the invention described above, the subjectimage data rather than the data provided by combining the subject imagedata and the background data is stored in the removable memory 57 andthe subject image data and the background data are associated with eachother according to the associating record stored in the setting table T.Therefore, the subject image data can be recorded in the removablememory 57 so that it can be drawn as it is combined with the selectedbackground data and that it can be drawn separately from the selectedbackground data. Further, if records for associating two or more piecesof background data with one piece of subject image data are stored inthe setting table T, the subject image data, the background data, andthe setting table T stored in the removable memory 57 are read in apersonal computer, etc., and the subject image data and the backgrounddata are combined based on the setting table T, whereby a plurality ofcomposite images can be created from one subject image data piecerecorded with the digital camera 1.

In the first embodiment of the invention, the information forassociating the subject image data and the background data with eachother is managed using the table, so that the information forassociating the subject image data and the background data with eachother can be easily edited and used.

Second Embodiment

FIG. 8 is a schematic drawing to show directories of files stored inremovable memory 57 with a digital camera 1 according to a secondembodiment. “¥removable” corresponds to the root directory of theremovable memory 57. Components in the second embodiment substantiallyidentical with those in the first embodiment are denoted by the samereference numerals in the second embodiment and will not be discussedagain.

A subject image file with extension “.exif” contains image datarepresenting the subject image formed on an image sensor 44 when ashutter button 28 is pressed, and is created in a digital imageprocessing section 52.

A file with extension “.ust” is an associating file for associating asubject image file and a layout definition file file with each other.The filename of an index file with extension “.usm” is described in theassociating file. The filename of the associating file is the same asthe filename of the subject image file to be associated with the layoutdefinition file described in the index file described in the associatingfile. For example, a filename of an index file, “daen_(—)0.usm,” isdescribed in an associating file “0002.ust” and the filenames of layoutdefinition files “daen01.usd,” “daen02.usd,” etc., are described in theindex file “daen_(—)0.usm.” That is, the subject image and theassociating file are associated with each other according to theirfilenames, and the associating file and the index file are associatedwith each other according to the filename described in the associatingfile. Further, the index file and the layout definition file areassociated with each other according to the filename of the layoutdefinition file described in the index file. The files are associatedwith each other, whereby a plurality of layout definition filesdifferent in paper size and having similitude relation are associatedwith one subject image file.

If a layout definition file is selected by menu operation before theshutter button 28 is pressed, the associating file is stored in theremovable memory 57 together with the subject image file when theshutter button 28 is pressed. As a transition is made from a playbackmode to a background setting mode, the layout definition file can beassociated with the subject image data already stored in the removablememory 57. In each associating file, text information indicating whetherthe associating file is set before the shutter button 28 is pressed oris set in the background setting mode is described.

A file with extension “.usd” is a layout definition file for definingthe print layout of a subject image and a default image and the layoutdefinition file is retained for each paper size. The layout definitionfile is described later in detail.

FIG. 9 is a schematic drawing to show various images stored in theremovable memory 57 in association with each other through the layoutdefinition file.

A subject image file 238 with extension “.exif” contains datarepresenting a subject image, essential image data 240 and thumbnailimage data 242, which are recorded in an Exif file format.

A default image file 244 with extension “.eff” contains datarepresenting a default image combined with a subject image based on thelayout definition file, default image data 246 and α channel data 248.The α channel data is data setting the transmittance of the upper layerbetween superposed layers for each pixel. For example, in pixels withthe transmittance set to 100% by the α channel data, a pixel in thelower layer rather than a pixel in the upper layer is adopted as a pixelof a composite image. If a script for drawing a default image isdescribed in the layout definition file, the subject image and thedefault image are related to each other through the layout definitionfile.

A preview image file 254 with extension “.usf” contains data to displaythe layout defined in the layout definition file on an LCD 26, previewimage data 250 and α channel data 252. The preview image file 254 isdisplayed in a mode of selecting the layout definition file to beassociated with the subject image file before the shutter button 28 ispressed and the background setting mode to which a transition can bemade from the playback mode. The size of a preview image is matched withthe size of a thumbnail image defined in the industrial standard such asExif, for example, whereby it is made possible to display the layoutdefined in the layout definition file at high speed using hardware fordisplaying the thumbnail image data of subject images at high speed.

A framing image file 260 with extension “.ctf” contains data to displaya part of the default image defined in the layout definition file(framing image) on an LCD of a digital camera, framing image data 256and α channel data 258. In a photographing mode, a framing image isdisplayed on the LCD 26, whereby appropriate framing responsive to theshape of the frame into which a default image is fitted is madepossible.

As shown in FIG. 8, the data representing a default image, the datarepresenting a preview image, and the data representing a framing imageare stored in the folder of the same name as the filename of the indexfile describing the filenames of the layout definition filescorresponding to the data.

The layout definition file, the index file, the default image file, thepreview image file, and the framing image file may be stored only in ROM70 or may be stored in the removable memory 57 until the associatingfile is stored in the removable memory 57. When the associating file isstored in the removable memory 57, if the layout definition file, theindex file, the default image file, the preview image file, and theframing image file are not stored in the removable memory 57, thesefiles are stored in the removable memory 57 together with theassociating file.

FIG. 10 is a schematic drawing to show the contents of a layoutdefinition file. FIG. 11 is a schematic drawing to show processing oflaying out a subject image and a default image for a postcard 260 usingthe layout definition file when a print command is accepted in thedigital camera 1 directly connected to a printer or when a print commandis accepted in a printer to which data can be input from the removablememory 57. Processing of creating print data of a composite image usingthe layout definition file, the subject image file, the default imagefile, etc., may be performed by a CPU 68 of the digital camera 1 or aCPU of a printer. To create print data by the CPU 68 of the digitalcamera 1, one-page image data to be printed is created using the layoutdefinition file, the subject image file, the default image file, etc.,and further color space conversion processing, resolution conversionprocessing, halftone processing, interlace processing, etc., isperformed for the image data to be printed to create print data, and theprint data is sent to a printer through an interface such as USB. Tocreate print data by the CPU of the printer, the layout definition file,the subject image file, and the default image file may be input to theprinter through an interface such as USB or the removable memory 57 andthe layout definition file may be interpreted in the printer. Todirectly connect the digital camera 1 and a printer for print, thedigital camera 1 may send only the default image file corresponding tothe paper size selected by the user through menu operation of thedigital camera 1 to the printer.

In the layout definition file, the layout of the subject image and thedefault image is defined by a script. The script defines the print papersize, the print paper orientation, the image frames to place the subjectimage and the default image on print paper, etc., so that they can beinterpreted uniquely in a printer, etc. Specifically, for example,“postcard” as the paper size and “landscape” as the print paperorientation are described by the script, the image frame (for example,upper left coordinates of the frame “(x1, y1)” and lower rightcoordinates of the frame “(x2, y2)”) is described by the script for eachsubject image to be printed, and the filename of the default image file(for example, “birthday.eff”) and the image frame (for example, upperleft coordinates of the frame “(x3, y3)” and lower right coordinates ofthe frame “(x4, y4)”) are described by the script for each default imageto be printed.

FIG. 12 is a drawing to show screen transition of the LCD 26 in the modein the playback mode. FIG. 12 (A) shows a screen on which a subjectimage stored in the removable memory 57 is displayed. To display thesubject image being selected, the essential image data of the subjectimage may be read from the removable memory 57 and scaled down beforedisplay, the thumbnail image data of the subject image may be read anddisplayed intact, or the thumbnail image data of the subject image maybe read and scaled up or down before display. If a default image isassociated with the subject image selected as the next selection key 20or the preceding selection key 22 is pressed, a part of the defaultimage is displayed as shown in FIG. 12 (B1) or text, icon, etc.,indicating that the default image is associated is displayed togetherwith the subject image, as shown in FIG. 12 (B2). If the determinationswitch 24 is pressed in a state in which the subject image with which adefault image is associated is displayed on the LCD 26, the whole of theimage into which the subject image and the default image are combined isdisplayed on one screen, as shown in FIG. 12 (C).

In the playback mode, one of the subject image files stored in apredetermined directory of the removable memory 57 is selected in ordereach time the next selection key 20 or the preceding selection key 22 ispressed. If the associating file of the same filename as the selectedsubject image file is stored in the directory, a screen indicating thata layout definition file is associated with the selected subject imagefile is displayed on the LCD 26 as shown in FIG. 12 (B1) or FIG. 12(B2). In this state, if the print start is accepted in the digitalcamera 1, the selected subject image file is printed in accordance withthe script described in the layout definition file associated with thesubject image file.

FIG. 12 (B1) and FIG. 12 (B2) show a state in which “0002.exif” shown inFIG. 8 is selected. Processing when a subject image file stored in theremovable memory in association with default image data is selected inthe playback mode will be discussed below with reference to a flowchartof FIG. 13:

First, the thumbnail image data 242, the framing image data 256, and theα channel data 258 shown in FIG. 9 are read from the removable memory57, and the thumbnail image data 242 and the framing image data 256 aresuperposed on each other on the LCD 26 as shown in FIG. 12 (B1) (S300).To display screen A in FIG. 12 (B2) and FIG. 14, image data representing“with frame” stored in the ROM of the control section 212 may bedisplayed in the upper layer of the thumbnail image data 242 of thesubject image.

If the next selection key 20 or the preceding selection key 22 ispressed in a state in which the subject image is displayed on the LCD26, another subject image file is selected (S310).

If the determination switch 24 is pressed in a state in which thesubject image is displayed on the LCD 26, the following processing fordisplaying the whole of the image into which the subject image and thedefault image are combined on one screen is started (S320): Thefollowing processing may be started when a timer started when anewsubject image file was selected times out.

First, the layout definition file is read and coordinate conversion ofthe image frame described in the script is executed in response to thescreen of the LCD 26 as shown in FIG. 11 (S330). A file describing thescript defining the image frame responsive to the screen of the LCD 26may be previously associated with the index file, etc., for storage. Inthis case, it is not necessary to read the layout definition file and itis not necessary either to execute coordinate conversion of the imageframe in the layout definition file.

Next, the thumbnail image 242 representing the subject image is scaleddown in response to the image frame subjected to the coordinateconversion as shown in FIG. 14 (S340).

Next, the preview image data 250 and the α channel data 252 in thepreview image file associated with the subject image file through theindex file are read from the removable memory 57. Subsequently, thewhole of the image into which the subject image and the default imageare combined is displayed on one screen of LCD 26 based on thescaled-down thumbnail image 242, the preview image data 250, and the αchannel data 252, as shown in screen B in FIG. 14. In this state, if theprint start is accepted in the digital camera 1, the selected subjectimage file is printed in accordance with the script described in thelayout definition file associated with the subject image file.

1. An image processing apparatus comprising: a first getter which gets afirst image; a second getter which gets an image group that includes: aplurality of second images each of which corresponds to a respective oneof output sizes; and a plurality of layouts each of which corresponds toa respective one of the second images and defines layout of the firstimage and a corresponding one of the second images; and a storing unitwhich stores associating data for associating the first image and theimage group.
 2. The image processing apparatus according to claim 2,wherein the second getter gets the image group from a nonvolatileexternal memory; and the storing unit stores the associating data in thesame nonvolatile external memory.
 3. The image processing apparatusaccording to claim 1, further comprising: a display unit which displaysa composite image representing the first image and one of the secondimages.
 4. The image processing apparatus according to claim 1, furthercomprising: a print control unit which causes a printer to print acomposite image representing the first image and one of the secondimages.
 5. The image processing apparatus according to claim 4, whereinthe print control unit creates the composite image.
 6. The imageprocessing apparatus according to claim 1, wherein the output sizes aresizes of mediums on which a composite image representing the first imageand a corresponding one of the second images is printed.
 7. The imageprocessing apparatus according to claim 1, wherein the second images inthe image group includes the same figure.
 8. A computer-readablerecording medium in which a computer program causing a computer toexecute a method is recorded, the method comprising: getting a firstimage; getting an image group that includes: a plurality of secondimages each of which corresponds to a respective one of output sizes;and a plurality of layouts each of which corresponds to a respective oneof the second images and defines layout of the first image and acorresponding one of the second images; and storing associating data forassociating the first image and the image group.